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Abstract 

NASA Ames Research Center has a diverse program in 
planning and scheduling. This paper highlights some 
of our research projects as well as some of our ap- 
plications. Topics addressed include machine learn- 
ing techniques, action representations and constraint- 
based scheduling systems. The applications discussed 
are planetary rovers, Hubble Space Telescope schedul- 
ing, and Pioneer Venus orbit scheduling. 

1 Introduction 

NASA Ames Research Center’s Artificial Intelligence 
Research Branch, led by Dr. Peter Friedland, has 
a diverse research program in planning and schedul- 
ing. Our work ranges from state-of-art fundamental 
research to applications of both new and existing tech- 
nology. This paper is intended to summarize and high- 
light some of these activities. 

The research issues we will highlight include: ma- 
chine learning and planning, planning representa- 
tions, non-symbolic representations, constraint-based 
scheduling, and the representation of procedural 
knowledge. 

The applications we will present include Hubble 
Space Telescope scheduling, Mars Rover planning and 
scheduling, and Pioneer Venus orbit scheduling. 

2 Planning and Scheduling 

It is important to clarify the terms “planning” and 
“scheduling” before we proceed. An agent plans by 
finding actions that will take it from its current state 


to another desired state. Classically, this is a goal di- 
rected search through a space of possible partial plans. 
Scheduling , on the other hand, refers to an agent plac- 
ing explicit times or orderings on a set of intended ac- 
tions. This is usually a search through a space of pos- 
sible timelines. In short, we call the process of find- 
ing actions that achieve goals planning and we call the 
placement of times on those actions scheduling. 

3 Research 

Our research program is a mix of internal research, 
university grants, and commercial contracts. Here we 
will present a representative subset of the program con- 
ducted at Ames, SRI, Stanford, and Carnegie-Mellon. 

3.1 Learning in Planning 

One of our group’s areas of focus is machine learning 
and we are particularly interested in its application 
to planning and scheduling. We are exploring ways to 
improve search performance through the application of 
explanation-based learning techniques [Mit87,DeJ87], 
The main idea behind this work is that a system can 
improve its performance by analyzing the solutions to 
problems it has previously encountered. As a result 
of this analysis, the system can remember the good 
decisions it made as well as the poor ones. Ideally, we 
would like the system to generalize from this analysis 
so that the knowledge gained from its retrospection will 
be useful in cases that are not only identical to the ones 
it encountered, but also those that are close enough so 
that the previous experience would prove relevant and 
helpful. 
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Dr. Steven Minton, of Carnegie-Mellon Univer- 
sity, performed a thorough analysis of a planning 
and learning system called PRODIGY [Min87,Min88]. 
PRODIGY is a STRIPS-like planner that employs 
explanation-based learning to acquire search control 
knowledge. His results showed that learning will not 
necessarily improve the performance of a planning sys- 
tem and in many cases it can degrade performance. 
As a result, Dr. Minton explored various methods of 
monitoring the utility of learned knowledge in order 
to transform (or possibly remove) learned knowledge 
to make the overall system more useful. Dr. Minton 
has recently joined our laboratory and will continue 
exploring planning and learning issues. 

Another project within our laboratory is also ad- 
dressing the utility problem in planning systems that 
learn. Monte Zweben and collaborators at the MITRE 
Corporation are specifically addressing the utility 
problem caused by the complexity of learned knowl- 
edge [Zwe88bj. When a planning system needs to make 
a decision it must consider the generalised information 
that it has learned. This pattern-matching overhead 
can overwhelm the system to the point where learned 
knowledge no longer aids efficiency. Using PRODIGY 
as a model, Mr. Zweben and his colleagues are develop- 
ing a system that employs explanation-based learning 
(EBL) to acquire search knowledge, but relaxes some 
of the constraints usually associated with EBL tech- 
niques. Specifically, EBL generalises from a single in- 
stance and guarantees the correctness of the learned 
knowledge. As a result, the learned information tends 
to be quite complex. This project's main extension to 
the PRODIGY model is the approximation of learned 
knowledge in the interest of lowering the expense of 
the relevancy check. As a result, this approximation 
of learned knowledge could be incorrect and must be 
monitored. If the learned knowledge is approximated 
erroneously and misleads the planner frequently, then 
the approximations must be refined. The goal of this 
project is to determine the approximation and refine- 
ment strategies that will result in an efficient and effec- 
tive collection of knowledge learned by an explanation- 
based component. 

3.2 Planning Representations 

Dr. Mark Drummond, of our group, takes a Net The- 
ory approach to the problem of planning, scheduling 
and control [Dru85,Dru87]. His approach has a num- 
ber of interesting features and advantages. Similar to 
Amy Lansky’s [Lan87j work, it views a plan as a set 


of constraints over a pre-specified set of actions. Un- 
like Lansky's GEM model, however, the Net Theory 
approach allows one to distinguish clearly between or- 
derings required by causality, and those that are sim- 
ply convenient, given the agent’s goals. The Net The- 
ory approach also begins to make clear the true role 
of least commitment planning , where orderings on ac- 
tions are postponed until an ordering decision must be 
made. Current plan representations frequently over- 
commit to specific orderings. This over-commitment 
is critical when dealing with complicated scheduling 
problems, since many orderings and conditions can- 
not be determined until a schedule is actually being 
carried out. The Net Theory approach currently being 
explored by Dr. Drummond allows complete postpone- 
ment of ordering decisions until all environmentally de- 
termined information is available. This permits a new 
view on the role of an agent's synthetic temporal data 
structure. These data structures can now be viewed 
as plans, schedules, or control programs, depending 
on the phase of overall system operation. This work 
does not view planning and scheduling as a one-time 
process, but rather, includes an explicit control phase 
where plans/schedules are incrementally modified to 
suit execution needs. 

Dr. Drummond is also exploring a number of other 
issues in his planning research including: the tradeoff 
of reactive and predictive scheduling, the role of means- 
ends analysis in planning, the integration of planning 
and scheduling mechanisms, the representation and 
derivation of conditional and iterative plans, the role of 
constraint-satisfaction in the planning process, and the 
use of domain constraints to control planning search 
(Dru88). 

3.3 Control Without Symbols 

The work of Dr. Stan Rosenchein, formerly of SRI 
International and now of Teleos Research, takes the 
perspective that expensive symbolic processing at run 
time can be avoided by compiling symbolic representa- 
tions into circuitry guaranteed to act in bounded time. 
Dr. Rosenchein and his colleague Leslie Kaelbling have 
developed a set of tools that enables one to design a 
robotic controller in a high-level language, which then 
gets compiled into efficient circuitry that can be simu- 
lated or manufactured in hardware [Kae88,Ros86]. The 
fundamental idea behind this work is that much of 
the expensive search (like pattern matching) employed 
by symbolic reasoners can be accomplished at com- 
pile time, allowing the robot to quickly process its sen- 
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sory information and react appropriately. One of their 
tools, Gapps [Kae88], takes a goal expression and rules 
in a goal decomposition language and outputs circuitry 
that will enable a system to take action given a goal and 
its current state. Their tool REX allows one to spec- 
ify behavior that takes sensory input and the system’s 
current state and updates the current state to reflect 
what has occurred in the system’s environment. REX 
allows one to specify the circuitry in a language more 
abstract than circuits, but less abstract than that of 
a programming language. They are currently design- 
ing a system called RULER which will allow one to 
design the state update circuitry in a logical language 
resembling PROLOG. Ultimately, this language will be 
compiled into REX specifications. 

This work is distinguished in that the REX language 
has been specifically designed to support analysis of 
any particular REX program to prove its correctness. 
Further, this work is currently used to control Flakey, 
the SRI mobile robot. We view this work as a realistic 
first step towards the production of efficient robotic 
control tools. It begins to show how a designer can 
allocate computational resources at different phases of 
the design and deployment process. 

3.4 Constraint-based Scheduling 

As previously mentioned, scheduling is the process 
of placing a pre-specified set of actions on a time- 
line ensuring that the schedule’s constraints are main- 
tained. One of our projects, led by Monte Zweben, 
addresses the formulation and resolution of complex 
scheduling and resource allocation problems using con- 
straints to represent scheduling knowledge and prefer- 
ences [Zwe88a]. Constraints are declarative representa- 
tions of relationships that abstract away control flow. 
They allow one to specify the relationships between 
the problem’s variables in a system and enable the 
system to automatically determine the computation 
path from known variables to the unknown [Sta77]. 
These representations can be used for lookahead in 
a search process. Lookahead or constraint propaga- 
tion results in less backtracking (i.e., fewer futile search 
paths) because commitments to various choices in the 
system are made only if they are compatible with the 
choices remaining in the system [Har 80 ,Ste 80 ]. How- 
ever, lookahead can result in unnecessary constraint 
propagation. To circumvent this problem, we employ 
a technique called delayed evaluation [Fil84]. A sys- 
tem employing delayed evaluation does not completely 
evaluate its data structures until they are accessed. We 


use the data structure streams [Abe85] which are lists 
that delay the evaluation of their tails (i.e., all the ele- 
ments of the list except the first element). The use of 
streams is advantageous for two main reasons: 1) their 
delayed evaluation circumvents unnecessary constraint 
propagation; 2) their delayed evaluation is transpar- 
ent to knowledge engineers because stream operations 
are quite similar to list operations and our model of 
constraint-satisfaction is based upon list operations. 

3.5 Procedural Knowledge 

Dr. Michael Georgeff of SRI International has devel- 
oped a system called PRS - Procedural Reasoning Sys- 
tem - that enables one to represent and use complex 
procedural knowledge [Geo86). PRS takes a set of pro- 
cedures and executes them in a goal-directed manner. 
It uses a declarative representation of procedures that 
extends the expressiveness of previous action repre- 
sentations. Actions in PRS can exhibit iteration and 
recursion and also can employ run-time conditional 
branching. Thus, decisions as to what action to per- 
form next can be dependent upon the runtime envi- 
ronment. PRS procedures can also be interrupted by 
other procedures, thereby allowing emergency recog- 
nition and exception handling. The ability to change 
its focus of attention quickly and to act conditionally 
makes PRS a highly reactive system. 

PRS also has interesting theoretical aspects in that it 
meets much of the rational agency criteria proposed in 
the recent philosophical literature. Because PRS be- 
haves like a rational agent there is potential for the 
development of interesting explanation components. 
PRS has been exercised in a very complex and inter- 
esting domain: malfunction handling for the reaction 
control system of the Space Shuttle. NASA diagnostic 
manuals were encoded in PRS resulting in an extensi- 
ble set of semi-autonomous procedures. 

4 Applications 

The Ames AI Research Lab performs state-of-the-art 
research, but does so in the context of real-world appli- 
cations. This allows us to both verify that our meth- 
ods scale-up to real problems and focus our research 
towards topics of interest to NASA. In addition to 
framing our research within NASA problems, we also 
demonstrate the utility of known AI techniques with 
engineering applications. Don Rosenthal is the direc- 
tor of our applications work. His applications projects 
include Pioneer Venus satellite scheduling and Hubble 
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Space Telescope scheduling. In fiscal year 1989, Mr. 
Rosenthal will explore planetary rover applications. 


4.1 Pioneer Venus 

This project, now completed, showed the utility of rule- 
based systems for operational software [Ros88]. We de- 
veloped a heuristic ground-based scheduler for science 
operations (e.g., instrument configurations, data stor- 
age and playback, telemetry, etc.) onboard the Pioneer 
Venus satellite. This software is currently performing 
a task in minutes which formerly took people hours. 
Further, the resulting schedules are as effective as the 
man-made ones but contain fewer flaws. The satellite’s 
operations are currently scheduled with this expert sys- 
tem. This scheduler is the first expert system installed 
in day to day use within a NASA mission operations 
environment. 


4.2 Hubble Space Telescope (HST) 
Scheduling 

Thousands of proposed observations for HST must 
be processed by the Space Telescope Science Institute 
(STScI), on the Johns Hopkins University campus in 
Baltimore, to construct schedules for the science op- 
erations of the orbiting optical observatory. Current 
software is not flexible or extensible enough to meet 
the operational demands expected on the system and 
we are helping to provide knowledge- based solutions to 
this problem [Mil87]. 

The HST projects we support take a constraint- 
based approach to scheduling. Dr. Stephen Smith, 
of Carnegie-Mellon University, is applying research in 
factory scheduling [Fox83,Smi86] to the HST problem. 
This approach is well suited for over-constrained prob- 
lems where a solution requires the relaxation of con- 
straints. 

Another project, at the STScI, is applying state-of- 
the-art constraint satisfaction techniques to the HST 
scheduling problem. Their goal is to produce a flexible 
and extensible scheduler that can dynamically react to 
anomalies and re-schedule accordingly. This work has 
resulted in a program called SPIKE, which uses piece- 
wise constant functions to quantitatively represent the 
degree of constraint violation. Using these functions, 
SPIKE can efficiently combine constraints as well as 
judge the options it must choose. 


4.3 Planetary Rovers 

In the coming year we will begin performing exten- 
sive research into the planetary rover problem while 
concentrating on the science planning and scheduling 
issues. Using the Mars Rover domain as a model, we 
are interested in rovers that can autonomously plan 
and execute an appropriate set of scientific analyses for 
many different science goals. Further, we will explore 
techniques that dynamically discover interesting sci- 
ence opportunities, and attempt to replan the rover’s 
actions to accomodate these new goals. 

Additionally, we will address the integration of nav- 
igation planning and science planning which will re- 
quire research in systems that negotiate for resources 
and time. 

We will also explore machine learning techniques 
that can improve the overall rover system. First, we 
will explore techniques that improve a system’s search 
performance. Second, we will address model refine- 
ment for rovers that begin with a rough and incomplete 
model of their environment. These techniques review 
a system’s actions and remembers when they succeed 
and when they fail. They also find discrepencies be- 
tween a system’s expectations and its observations and 
uses these discrepencies to refine the system’s models. 


5 Summary 

This paper is intended to selectively introduce our re- 
search and to point out references to technical pa- 
pers. Some of the areas currently addressed by our 
group but not discussed here are: 1) planning with in- 
complete models [Car87b,Car87a], 2) the use of truth- 
maintenance in planning [Mor86], and 3) communicat- 
ing, cooperating agents [Nil87]. In the coming year, we 
plan to expand our efforts in multi-agent planning and 
constraint satisfaction. The overall goal of the program 
is to develop the technology for large-scale automation 
of space missions. 
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